Visual lexical stress information in audiovisual spoken-word recognition
نویسندگان
چکیده
Listeners use suprasegmental auditory lexical stress information to resolve the competition words engage in during spoken-word recognition. The present study investigated whether (a) visual speech provides lexical stress information, and, more importantly, (b) whether this visual lexical stress information is used to resolve lexical competition. Dutch word pairs that differ in the lexical stress realization of their first two syllables, but not segmentally (e.g., 'OCtopus' and 'okTOber'; capitals marking primary stress) served as auditory-only, visual-only, and audiovisual speech primes. These primes either matched (e.g., 'OCto-'), mismatched (e.g., 'okTO-'), or were unrelated to (e.g., 'maCHI-') a subsequent printed target (octopus), which participants had to make a lexical decision to. To the degree that visual speech contains lexical stress information, lexical decisions to printed targets should be modulated through the addition of visual speech. Results show, however, no evidence for a role of visual lexical stress information in audiovisual spoken-word recognition.
منابع مشابه
Stress and lexical activation in dutch
Dutch listeners were slower to make judgements about the semantic relatedness between a spoken target word (e.g. atLEET, 'athlete') and a previously presented visual prime word (e.g. SPORT 'sport') when the spoken word was mis-stressed. The adverse effect of mis-stressing confirms the role of stress information in lexical recognition in Dutch. However, although the erroneous stress pattern was ...
متن کاملTowards a lexical fuzzy logical model of perception: the time-course of audiovisual speech processing in word identification
This study investigates the time-course of information processing in both visual as well as in the auditory speech as used for word identification in face-to-face communication. It extends the limited previous research on this topic and provides a valuable database for future research in audiovisual speech perception. An evaluation of models of speech perception by ear and eye in their ability ...
متن کاملEffect of Lexical Frequency and Neighborhood Density on Audiovisual Spoken Word Recognition
The current study investigated how lexical factors influence the intelligibility of spoken words, and how those effects interact with visual information. A forced-choice word-identification experiment was carried out under auditory-visual and auditoryonly conditions with varying S/N ratios, and the effects of lexical frequency and neighborhood density on identification accuracy were analyzed. T...
متن کاملEffects of Multimodal Presentation and Lexical Density on Immediate Memory Span for Spoken Words
Working memory span for spoken words was measured using a non-repeated sampling procedure. Stimuli were presented in audio-only (AO) or audiovisual (AV) conditions. In the AO condition, participants were presented with only the audio track of a talker's voice. In the AV condition, participants simultaneously heard and saw a talker speaking a word. The stimulus words differed in their neighborho...
متن کاملSuprasegmental lexical stress cues in visual speech can guide spoken-word recognition.
Visual cues to the individual segments of speech and to sentence prosody guide speech recognition. The present study tested whether visual suprasegmental cues to the stress patterns of words can also constrain recognition. Dutch listeners use acoustic suprasegmental cues to lexical stress (changes in duration, amplitude, and pitch) in spoken-word recognition. We asked here whether they can also...
متن کامل